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ABSTRACT* 

Objective: The aim of this study was to design and 
validate a questionnaire to measure perceived symptoms 
associated with antihypertensive drugs (PERSYVE). 
Methods: The PERSYVE development and validation 
included four stages: 1) item development (bibliographic 
review and questionnaire elaboration); 2) face and content 
validation; 3) field testing (pre-test); and 4) test-retest 
validation, assessment of internal consistency (Cronbach's 
alpha) and reproducibility over time (intraclass correlation 
coefficient and Cohen's kappa coefficient). 
Results: PERSYVE is divided into six sections according 
to results obtained from the literature review: (1) drug 
adherence, (2) perceived symptoms and how they affect 
quality of life (five-point Likert scale), (3) communication 
with health professionals, (4) perception of symptoms as 
adverse reactions, (5) influence on therapy compliance, 
and (6) adoption of non-pharmacological methods for 
blood pressure control. Content and face validation of the 
questionnaire led to some vocabulary changes and the 
introduction of section 2.1. Field-testing (n=26) revealed 
high comprehensibility of the questions. The Cronbach's 
alpha, calculated for section 2 (five-point Likert scale) was 
0.850. PERSYVE was reproducible (n=167): kappa values 
presented fair to substantial reproducibility and, in section 
2, ICC values resulted in good to excellent reproducibility. 
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Conclusion: Results showed that PERSYVE is a well- 
structured, objective, patient-friendly, valid and reliable 
questionnaire. PERSYVE can be a very useful instrument 
in hypertensive patients' monitoring and in the screening 
of adverse effects. 

Keywords: Antihypertensive Agents; Drug-Related Side 
Effects and Adverse Reactions; Medication Adherence; 
Questionnaires; Validation Studies as Topic; Portugal 



INTRODUCTION 

Hypertension is a pathological condition and a 
highly prevalent cardiovascular risk factor 
worldwide 1 , related to mortality, cerebrovascular 
and cardiovascular diseases 2 , cognitive function 
impairment and dementia. 3 

Antihypertensive therapy leads to high success 
rates in the treatment of hypertension. However, 
adverse effects arising from the use of these drugs 
have often been reported 4 , being one of the most 
common causes of antihypertensive therapy 
replacement or dropout. 5,6 Therefore, it is crucial to 
know how antihypertensive therapies and drug use 
affect patients' quality of life (QoL) and therapy 
compliance. 7 In clinical practice, methods to monitor 
treatment adherence, such as electronic monitoring 
devices, pill counts and ascertaining rates of refilling 
prescriptions, are useful but difficult to perform. The 
most practical way to collect this information is by 
patients' self-reporting by means of interviews or 
self-administered questionnaires. 8,9 

For the reasons set out in the last paragraph, 
PERSYVE was designed and validated as an 
original questionnaire to measure patients' 
compliance, adverse drug events, communication 
skills and behavioural issues regarding 
antihypertensive drugs. 

There are several studies showing the usefulness of 
questionnaires to assess rational drug use 10,11 , 
patients' perception of symptoms and of adverse 
drug reactions 1 ,13 , to measure patients' knowledge 
about their disease 14 and as a complement to 
diagnosis or disease management. 15 ' 16 PERSYVE 
differs from the existing questionnaires because it 
provides a unique tool with which to assess different 
factors that influence therapy and enables active 
research (through a check-list) into common 
adverse effects of antihypertensive drugs. 
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METHODS 

To develop and validate PERSYVE, four stages 
were performed: 1) item development; 2) face and 
content validation; 3) field testing (pre-test); and 4) 
test-retest validation survey. 

Stage 1: Item development 

PERSYVE development started with a bibliographic 
review on PubMed, Ovid and ProQuest databases, 
using the following keywords: antihypertensive 
drugs; patient adherence; adverse effects; and 
questionnaire. The bibliographic review aimed the 
elaboration of the questionnaire items, which 
included the assessment of patients' compliance 
issues, adverse drug events related to 
antihypertensive drugs, communication skills and 
behavioural issues regarding antihypertensive drug 
use. Bibliography used on the review focused on 
patient self-reported adverse effects, adherence to 
therapeutics, frequently observed symptoms and 
adverse reactions related to antihypertensive drugs. 

PERSYVE was designed to be filled in by health 
professionals as a communication instrument with 
patients, exploring six different issues related to 
antihypertensive drug use and patients' perceptions 
of adverse reactions. These six issues were 
examined through six approaches: 

1) Haynes-Sackett methodology self-reported 
compliance method, used to assess the 
percentage of therapy adherence through 
evaluating the percentage of missed doses 9,17 ; 

2) Assessment of how QoL is affected by 25 side 
effects frequently experienced during 
antihypertensive therapy; 

3) Communication of adverse drugs reactions; 

4) Discovery of which symptoms, if any, patients 
felt and related to antihypertensive therapy; 

5) Assessment of how symptoms affect the 
compliance to antihypertensive drug therapy; 

6) Assessment of complementary therapy, i.e., non- 

pharmacological therapy, to control blood 
pressure. 

In section 2, a five-point Likert scale, ranging from 
"never affects" to "always affects", was used to 
assess the impact of each symptom on patients' 
QoL. Other sections used nominal yes/no variables. 

Stage 2: Item content and face validation 

Content validity is defined as the extent to which the 
concepts of interest are comprehensively 
represented by the scales set out. Three pharmacy 
PhDs, two in pharmacology and one in 
pharmacoepidemiology, and three physicians, one 
PhD expert in hypertension, one cardiologist and 
one general practitioner, were asked to evaluate the 
content validity of the questionnaire. The evaluation 
was based on the following five key points 18 : the 
measurement aims of the questionnaire (whether 
PERSYVE measures patients' compliance, adverse 
drug events, communication skills and behavioural 
issues regarding antihypertensive drug use), the 
target population (is the questionnaire tailored for 
the hypertensive population?), concepts intended 
for measurement (does the questionnaire cover all 
important aspects related to antihypertensive drug 



use?), question selection, and finally concision and 
interpretability. 

A language professor and a clinical psychologist, 
both PhD, evaluated the interface validity of the 
questionnaire, which included the evaluation of 
grammar, the logical sequence of the statements 
and overall appropriateness. 19 

Stage 3: Field testing (pre-test) 

At this stage, the - internally - validated version of 
the questionnaire was tested to evaluate its clarity, 
comprehensiveness and mean interview duration. 
This served to assess the acceptability of the 
questions, to ascertain whether there were any 
perceived problems during the interview and to 
clarify whether there were relevant aspects missing. 

The field testing was conducted in a general 
practice setting, by the same interviewer who 
developed the subsequent questionnaires (DDS). 
Seven general practitioners and 31 hypertensive 
patients recruited by consecutive sampling 
participated in the test. 

Patients over 18 years of age, clinically diagnosed 
with essential hypertension and under 
pharmacological antihypertensive therapy for at 
least six months were invited to participate. 
Individuals who did not meet these inclusion criteria, 
such as those with hypertension as a consequence 
of other diseases or conditions, those with mental 
disabilities and those who refused to participate, 
were not enrolled in the study. 

Stage 4: Test-retest validation survey 

Participants' selection 

The population consisted of patients from a primary 
health care unit in Matosinhos, Portugal. 
Hypertensive patients were recruited by consecutive 
sampling over a two-month period. The inclusion 
criteria were the same as those in the pilot test 
developed in the field testing stage. All 20 
physicians who had performed adult health 
consultations during this period agreed to 
participate. 

Patients were invited by their physician to enrol in 
the study. The interviews were performed by a 
pharmacist researcher (DDS) in similar conditions to 
a medical appointment. Information was gathered 
from patients by interview after their medical 
appointments. The researcher was unaware of the 
patients' clinical cases. At the end of the first 
interview, patients were scheduled for a second 
interview. As in previously published studies 20,21 , a 
retest was performed two to four weeks after the 
first interview. 

Ethics 

The study was conducted after the approval of the 
Ethics Committee. A brief explanation of the study 
was given to all involved, physicians and patients, 
and all were asked to sign a consent form. 
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Psychometric tests and statistical analysis 

Psychometric tests allowed the assessment of the 
internal consistency and reproducibility of 
PERSYVE items. 

The internal consistency of the PERSYVE was 
evaluated by Cronbach's alpha coefficient. 22,23 
Cronbach's alpha is the most widely used objective 
measurement of internal consistency. It varies from 
0 to 1 and describes the extent to which all the 
items in a test measure the same concept or 
construct. For an instrument with nominal/ordinal 
outcome variables (as in the 1-5 Likert scale), it is 
acceptable to obtain values of Cronbach's alpha 
above 0.7. Since the questionnaire was not a single 
construct, a value was only calculated for the 25 
items in section 2. 

The reproducibility of the questionnaire was carried 
out by test-retest method. In all sections of 
PERSYVE, excluding section 2, the reproducibility 
was measured using the Cohen's kappa 
coefficient. 24 This coefficient kappa, is frequently 
used as a reproducibility measurement for repeated 
assessments of the same variable and could be 
defined as an inter-rater statistical method used to 
estimate the agreement level of categorical data. 
The reproducibility in section 2 of PERSYVE was 
measured using the one-way random effects model 
for single measures, known as intraclass correlation 
coefficients (ICCs), a statistical method of 
measuring reproducibility of replicates from the 
same subject. A one-way ICC was chosen because 
the effect of the trials is not crossed with subjects 
(i.e., a replication study; hence, one-way) and the 
analysis is used to generalize from a trial based on 
a sample (thus, random). All interviews were 
conducted by the same researcher (DDS); hence, 
inter-observer reliability was not evaluated. 

The collected data was coded and inserted in a 
database. Data was randomly checked to evaluate 
transcription errors. Statistical analysis was 
performed using IBM SPSS Statistics for Windows, 
Version 19.0, Armonk, NY: IBM Corp. 

RESULTS 

Stage 1: Item development 

PERSYVE (online supplementary material) is 
mainly composed of closed questions, divided into 
six main sections to assess patient compliance, 
adverse drug events, communication skills and 
behavioural issues regarding antihypertensive drug 
use. These sections are as follows: 

1. Many patients have difficulties taking their 
medicines as the physician recommended. In the 



past three months, was there any day or period of 
time when you did not take the drugs for blood 
pressure as recommended? Section 1 evaluates the 
adherence to therapy, the reasons for 
noncompliance and the patients' opinion about the 
influence of adherence on their blood pressure 
control. 

2. In the last three months did you feel any of the 
following symptoms? Section 2 attempted to 
understand which symptoms affect patients' QoL, 
and how (using a five-point Likert scale). 

3. Have you ever spoken with someone about these 
symptoms? Section 3 studied whether the 
symptoms were discussed with health professionals 
around the patient, exploring the reasons why 
patients did not report their symptoms. 

4. Do you think the symptoms you have had may be 
caused by your medication? Section 4 attempts to 
evaluate whether patients perceived their symptoms 
as adverse effects or whether they did not see a 
causal relationship. 

5. Have these symptoms led you to change or stop 
your medicine intake? Section 5 assessed whether 
the described symptoms contributed to drug misuse 
and non-compliance. 

6. Do you take other measures to help reduce your 
blood pressure? Section 6 explored patients' 
actions for non-pharmacological blood pressure 
control. 

Stage 2: Item content and face validation 

The expert consensus revealed that PERSYVE has 
sound face and content validity. The general opinion 
was that the questionnaire was well structured and 
included all important issues regarding patients' 
compliance, adverse drug events, communication 
skills and behavioural issues. Experts suggested 
the introduction of a question about how symptoms 
affected patients' QoL resulting in item 2.1, 
evaluated using a five-point Likert scale. The 
evaluation of the face validity by the panel of 
experts resulted in minor vocabulary and 
grammatical changes; no significant change was 
made to the questionnaire. 

Stage 3: Field testing 

Participants 

Interviews were carried out with essential 
hypertension patients (n=31). Five individuals did 
not meet the inclusion criterion "6 months or less 
under antihypertensive drug therapy". Therefore, 
data from the remaining individuals was used 
(n=26). 



www.pharmacypractice.org (issn: is86-3655) 



3 



Duarte-Silva D, Figueiras A, Herdeiro MT, Teixeira Rodrigues A, Silva Branco F, Polonia J, Figueiredo IV. PERSYVE 
- Design and validation of a questionnaire about adverse effects of antihypertensive drugs. Pharmacy Practice 2014 
Apr-Jun;12(2):396. 



Table 2. Cohen's kappa coefficients of the sections 1 , 3, 4, 5 and 6 of PERSYVE 


Section 


Cohen's Kappa 


Sample size 


n=124 


1 . Many patients have difficulties taking their medicines as the doctor recommended. In 
the past three months, was there any day or period of time when you did not take the 
drugs for blood pressure as recommended? 

Forgetfulness 
Economic reasons 
Drugs cause discomfort or malaise 
Blood pressure was normal 
Blood pressure was too low 
Blood pressure remained high 


0.462*** 

0.412* 
0.520** 
0.474** 
0.516** 
0.651*** 

a 


3. Have you ever spoken with someone about these symptoms? 

Specialist doctor 
General practitioner 
Other doctor 
Pharmacist 
Nurse 
Family/friends 


0.330*** 
0.386 
0.260** 
0.517*** 
0.381** 
0.561*** 
0.286* 


4. Do you think the symptoms you had may be caused by your medications? 


0.461*** 


5. Have these symptoms led you to change the intake of medicines or stop taking 
them? 


0.228** 


6. Do you take other measures to help reduce your blood pressure ? 

Exercise 
Diet 

Avoid salt intake 
Weight control (try not to get fat) 
Avoid stress 

Take a dietary supplement to control blood pressure 


0.724*** 
0.747*** 
0.654*** 
0.539*** 
0.394*** 
0.466*** 


a no answers; *p< 0.05; **p<0.01; ***p<0.001 



Table 1 describes the socio-demographic 
characteristics of the individuals included in the pre- 
test. 

PERSYVE field testing 

During PERSYVE field-testing, none of the patients 
refused to answer the questionnaire and questions 
were well understood by patients. The investigator 
(DDS) did not notice any difficulty in the 
interpretation or comprehension of the questions by 
the participants. Filling in the questionnaire took, on 
average, 10 minutes. 

Stage 4: Test-retest validation survey 

Participants 

Two hundred and nine hypertensive patients 
(n=209) were invited to participate in the study. Of 
these, four refused to participate and two missed 
the interview. Two hundred and three (n=203) 
patients attended the first interview (test). Of these, 
34 were excluded because they did not meet the 
inclusion criteria: three patients had discontinued 
antihypertensive drugs and 31 had started or 
changed antihypertensive therapy less than six 
months prior to the interview date. 

At the second interview (retest), we collected data 
from 135 of the remaining 169 patients. Thirty-four 



patients did not attend the interview. There were 
nine cases of therapy change between the first and 
the second interview and it was found that two 
individuals had started a new antihypertensive drug 
less than six months before (information had been 
omitted at the first interview), hence, in these cases 
interviews were not considered. 

Summarily, there were 167 valid first interviews 
(test) and 124 valid second interviews (retest). 

Socio-demographic characteristics are presented in 
Table 1. Socio-demographic characteristics were 
not used to assess any relationship with the 
dimensions evaluated by PERSYVE. However, as 
shown in Table 1, socio-demographic 
characteristics are very similar in all stages of this 
study (pre-test, test and retest). 

Internal consistency 

The Cronbach's alpha calculated for the Likert scale 
of symptoms (section 2) was considered acceptable 
(alpha=0.850). 

Reproducibility 

Table 2 presents the results obtained for kappa. 
Considering the classification presented by Landis 
& Koch 24 , kappa values obtained revealed, at least, 
fair to substantial reproducibility, which represents 
the level of agreement between answers. 



Table 1. Socio-demographic characteristics of the participants included in the pre-test, test and retest 




Pre-test 


Test 


Re-test 


Sample Size 


n = 26 


n = 167 


n = 124 


Gender 








Women 


18(69%) 


1 1 1 (66%) 


80 (65%) 


Men 


8(31%) 


56 (33%) 


44 (35%) 


Age - mean (SD) 


63 (11) 


67 (9) 


67 (9) 


School level, n (%) 








Illiterate 


2 (8%) 


15 (9%) 


9 (7%) 


< 4 years 


19(73%) 


118 (71%) 


90 (73%) 


>4 < 9 years 


4 (15%) 


23(14%) 


19(15%) 


> 12 years 


1 (4%) 


10 (6%) 


6 (5%) 
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Table 3. Intraclass correlation coefficients for section 2 of 
PERSYVE 



Symptoms 


ICC (95%CI) 


Tiredness 


0.738 (.627 


.816)*** 


Feeling faint 


0.624 (.465 


.736)*** 


Sweats 


0.840 (.772 


.888)*** 


Gripes 


0.774 (.677 


.841)*** 


Nausea 


0.627 (.469 


.739)*** 


Diarrhoea 


0.493 (.277 


.644)*** 


Constipation 


0.897 (.853 


.928)*** 


Palpitations 


0.566 (.381 


.695)*** 


Swollen feet or legs 


0.779 (.685 


.845)*** 


Cold hands or feet 


0.674 (.536 


772)*** 


Muscle pain 


0.824 (.750 


.877)*** 


Cramps 


0.799 (.713 


.859)*** 


Headaches 


0.834 (.763 


.883)*** 


Dizziness 


0.596 (.424 


.716)*** 


Anxiety 


0.794 (.706 


.855)*** 


Sadness 


0.817 (.740 


.872)*** 


Sleep poorly 


0.757 (.654 


.829)*** 


Shortness of breath or breathing 


0.763 (.662 


.834)*** 


difficulty 






Persistent dry cough 


0.519 (.375 


.663)*** 


Itching 


0.761 (.659 


.832)*** 


Skin rash 


0.621 (.460 


.734)*** 


Swollen or red face 


0.707 (.582 


.794)*** 


Dry mouth 


0.813 (.733 


.869)*** 


Frequent urination 


0.803 (.719 


.862)*** 


Decreased sexual desire or ability 


0.780 (.687 


.846)*** 


* = p< 0.05; ** = p<0.01 ; *** = p<0.001 

ICC=lntraclass correlation coefficient; 95%IC=95% 



confidence interval 



In section 2 of PERSYVE, ICCs revealed good to 
excellent reproducibility of all evaluated symptoms 
(Table 3). 

DISCUSSION 

According to the World Health Organization, there is 
a need for the development of valid and reliable 
instruments to collect data on the determinants of 
hypertension treatment. 25 Questionnaires intended 
for the clinical setting must be patient-friendly, valid, 
reliable and open to minor changes. The evaluation 
should also be easy to perform and the results must 
be easily coded and interpreted. 26 All stages of the 
PERSYVE validation confirmed that this instrument 
is a well-structured, clear, objective, easy to 
implement, valid and reliable tool. 

PERSYVE may be used as a complement to 
anamnesis and as a screening method for adverse 
effects. It will also provide the clinical practitioner 
with patients' beliefs about other non- 
pharmacological treatments and evaluate therapy 
compliance. Patients tend to value symptoms more 
than physicians do when reporting daily health 
status. 27 Patients' self-declarations of adverse drug 
reactions are already part of the pharmacovigilance 
mechanisms in some countries 28 and self- 
declaration could be a very useful indicator of 
rational use of medicines. 11 This supports the 
importance of promoting communication between 
health professionals and patients, and we consider 
PERSYVE a good means to that end. Moreover, it 
can help patients to cope with antihypertensive 
therapy and to improve compliance. 



It is also important to draw attention to the results of 
the design and evaluation of the questionnaires, so 
they can be used as trustworthy resources for other 
researchers. 

Both experts' panels, which assessed the content 
and face validity of PERSYVE, made some 
suggestions for improving PERSYVE's 
acceptability, such as better interpretability and 
comprehensiveness of the questionnaire, and 
suggested raising its clinical interest by adding the 
evaluation of the effect of symptoms on the patients' 
QoL 

Psychometric analysis confirmed the internal 
consistency (Cronbach's alpha) and the 
reproducibility (kappa and ICC) of PERSYVE. 
PERSYVE Cronbach's alpha values indicated that 
there is internal consistency. For an instrument with 
nominal/ordinal outcome variables, it is acceptable 
to obtain values of Cronbach's alpha 0.7 or higher. 23 

The psychometric characteristics of PERSYVE are 
similar to those of other validated questionnaires 
that studied symptoms perceived by chronic 
patients 29 , patients' knowledge about their disease 
and treatment 30,31 and other subjects related to the 

i -i 32,33 

use of drugs. 

Regarding the limitations of this study, the 
consecutive selection of participants in a convenient 
sample, the performance of the recruitment by 
general practitioners and the characteristics of the 
sample population (such as advanced age), may 
introduce selection and response bias. 34,3 Women 
comprised the majority of the interviewed subjects, 
but this is consistent with characteristics of the 
studied population. Concerning PERSYVE 
validation, its use in self-declaration was not 
evaluated due to patients' low literacy levels. Its 
external validity was not established either. The 
main limitation of the test-retest method is the 
potential for learning or recalling effects that can 
affect the test's result - the two weeks' interval 
between measurements is fundamental to this, 
since it is long enough to avoid carryover effects 
due to memory and short enough to exclude 
changes in patient behaviour. 

CONCLUSIONS 

PERSYVE is a reliable, patient-friendly 
questionnaire that is easily implemented in the 
clinical practice. Therefore, PERSYVE could be a 
very useful tool to assess dimensions related to 
antihypertensive therapy; more specifically, to 
assess perceived symptoms related to 
antihypertensive drugs, to screen for potential 
adverse effects and to better understand the factors 
that underlie poor compliance. 

In the future, PERSYVE should be externally 
validated, tested in a patient fill out trial and in other 
countries in order to expand its applicability. 
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PERSYVE - DISENO Y VALIDACION DE UN 
CUESTIONARIO SOBRE EFECTOS AD VERSOS 
DE ANTIHIPERTENSIVOS 

RESUMEN 

Objetivo: El objetivo de este estudio fue disenary 
validar un cuestionario para medir los sintomas 
percibidos asicados a medicamentos antihipertensivos 
(PERSYVE). 

Metodos: El desarrollo y validacion de PERSYVE 
incluyo cuatro etapas: 1) desarrollo de items (revision 
bibliografica y elaboration del cuestionario); 2) 
validacion de rostro y de contenido; 3) prueba de campo 
(pre-test); y 4) validacion test-retest, evaluation de la 
consistencia interna (alfa de Chronbach) y 



reproductibilidad en el tiempo (coeficiente de correlation 
intra-clases y coeficiente kappa de Cohen). 
Resultados: De acuerdo con los resultados obtenidos de 
la revision de la literatura, PERSYVE se divide en seis 
secciones: (1) adherencia a medicamentos, (2) sintomas 
percibidos y como afectan a la calidad de vida (escala 
Likert de cinco puntos), (3) comunicacion con los 
profesionales de la salud, (4) perception de sintomas 
como reacciones adversas, (5) influencia en el 
cumplimiento del tratamiento, y (6) adoption de metodos 
no farmacologicos para el control de la presion arterial. 
La validacion de rostro y de contenido del cuestionario 
llevaron a algunos cambios de vocabulario y a la 
introduction de la seccion 2.1. El ensayo de campo 
(n=26) revelo una alta comprensibilidad de las preguntas. 
El alfa de Cronbach calculado para la seccion 2 (escala 
de Likert de 5 puntos) fue de 0,850. PERSYVE fue 
reproducible (n=167): valores de kappa presentaron una 
reproductibilidad sustancial y, en la seccion 2, los valores 
de ICC resultaron de buenos a excelentes. 
Conclusion: Los resultados demostraron que PERSYVE 
es un cuestionario bien estructurado, objetivo, facil de 
usar para el paciente, valido y confiable. PERSYVE 
puede ser un instrumento muy util en la monitorizacion 
de pacientes hipertensos y en el rastreo de efectos 
adversos. 

Palabras clave: Antihipertensivos; Efectos colaterales de 
y reacciones adversas de los medicamentos; 
Cumplimiento de la Medication; Cuestionarios; Estudios 
de Validacion como Asunto; Portugal 
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